Necessary and sufficient conditions for differentiating 
under the integral sign 



Erik Talvila 

1. Introduction. When we have an integral that depends on a parameter, 
say F{x) = f{x,y) dy, it is often important to know when F is differen- 
tiable and when F'{x) = fi{x^y) dy. A sufficient condition for differenti- 
ating under the integral sign is that fi (x, y) dy converges uniformly; see H, 
p. 260]. When we have absolute convergence, the condition \fi{x,y)\ < g{y) 
with J^g{y)dy < oo suffices (Weierstrass M-test and Lebesgue Dominated 
Convergence). If we use the Henstock integral, then it is not difficult to give 
necessary and sufficient conditions for differentiating under the integral sign. 
The conditions depend on being able to integrate every derivative. 

If g:[a,b] — M is continuous on [a, b] and differentiable on (a, b) it is not al- 
ways the case that g' is Riemann or Lebesgue integrable over [a, b]. However, 
the Henstock integral integrates all derivatives and thus leads to the most 
complete version of the Fundamental Theorem of Calculus. The Henstock in- 
tegral's definition in terms of Riemann sums is only slightly more complicated 
than for the Riemann integral (simpler than the improper Riemann integral), 
yet it includes the Riemann, improper Riemann, and Lebesgue integrals as 
special cases. Using the very strong version of the Fundamental Theorem 
we can formulate necessary and sufficient conditions for differentiating under 
the integral sign. 

2. An introduction to the Henstock integral. Here we lay out the 

facts about Henstock integration that we need. There are now quite a number 
of works that deal with this integral; two good ones to start with are [|I| and 

i- 

Let / : [— oo, oo] — (oo, oo). A gauge is a mapping 7 from [—00, 00] to the 
open intervals in [—00, 00]. By open interval we mean (a, b), [—00, b), (a, 00], 
or [—00, 00] for all —00 < a < 6 < 00 (the two-point compactification of the 
real line). The defining property of the gauge is that for all x G [—00,00], 
7(0;) is an open interval containing x. A tagged partition of [—00, 00] is a 
finite set of pairs V = {{zi, li)}^^, where each /j is a nondegenerate closed 
interval in [—00, 00] and Zi G Jj. The points Zi G [—00, 00] are called tags 
and need not be distinct. The intervals {/jj^i form a partition: For i 7^ j, 
li n Ij is empty or a singleton and ^f^ih = [—00, 00]. We say V is j-fine if 
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li C 'j{zi) for all 1 < z < A^. Let |/| denote the length of an interval with 
|/| = for an unbounded interval. Then, / is Henstock integrable, and we 
write f = A, if there is a real number A such that for all e > there is a 
gauge function 7 such that if V = {{zi, is any 7-fine tagged partition 

of [—00, 00] then 

N 

\I,.\-A 



< e. 



Note that is not fixed and the partitions can have any finite number of 
terms. We can integrate over an interval [a, b] C [—00, 00] by multiplying the 
integrand with the characteristic function X[a,fe]- 

The more dramatically a function changes near a point z, the smaller 
7(2) becomes. With the Riemann integral the intervals are made uniformly 
small. Here they are locally small. A function is Riemann integrable on a 
finite interval if and only if the gauge can be taken to assign intervals of 
constant length. It is not too surprising that the Henstock integral includes 
the Riemann integral. What is not so obvious is that the Lebesgue integral 
is also included. And, the Henstock integral can integrate functions that 
are neither Riemann nor Lebesgue integrable. An example is the function 
f = g' where g{x) = a:^sin(l/x^) for x 7^ and g{0) = 0; the origin is 
the only point of nonabsolute summability. See p. 148] for a function 
that is Henstock integrable but whose points of nonabsolute summability 
have positive measure. A key feature of the Henstock integral is that it is 
nonabsolute: an integrable function need not have an integrable absolute 
value. 

The convention |/| = for an unbounded interval performs essentially 
the same truncation that is done with improper Riemann integrals and the 
Cauchy extension of Lebesgue integrals. A consequence of this is that there 
are no improper Henstock integrals. This fact is captured in the following 
theorem, which is proved for finite intervals in |^ . 

Theorem 1 Let f be a real-valued function on [a,b] C [—00,00]. Then J^^ f 
exists and equals A & M. if and only if f is integrable on each subinterval 
[a, x] C [a, b] and lim^^f,- f exists and equals A. 

Lebesgue integrals can be characterised by the fact that the indefinite 
integral F{x) = / is absolutely continuous. A similar characterisation 
is possible with the Henstock integral. We need three definitions. Let 
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F : [a, b] —>■ M. We say F is absolutely continuous [AC) on a. set E (1 [a, b] 
if for each e > there is some 6 > such that J2iLi l-^(^j) ~ < ^ ^r 

all finite sets of disjoint open intervals {{xi,yi)}^i with endpoints in E and 

say that F is absolutely continuous in the restricted 

sense (AC^) if instead we have J2i=i^^'Px,ye[x,,yi] l-^(^) ~ ^iy)\ < ^ under 
the same conditions as with AC. And, F is said to be generalised absolutely 
continuous in the restricted sense {ACG^) if F is continuous and E is the 
countable union of sets on each of which F is AC^,. Two useful properties 
are that among continuous functions, the ACG^ functions are properly con- 
tained in the class of functions that are differentiable almost everywhere and 
they properly contain the class of functions that are differentiable nearly ev- 
erywhere (differentiable except perhaps on a countable set). A function / is 
Henstock integrable if and only if there is an ACG^ function F with F' = f 
almost everywhere. In this case F{x) — F{a) = f. For an unbounded 
interval such as [0, oo], continuity of / at cx) is obtained by demanding that 
lim^^^oo F{x) exists. 

We have given an example that shows that not all derivatives are Lebesgue 
integrable. However, all derivatives are Henstock integrable. This leads to a 
very strong version of the Fundamental Theorem of Calculus. A proof can 
be pieced together from results in [^. 

Theorem 2 (Fundamental Theorem of Calculus) 

I Let f : [a,b] M. Then f exists and F{x) = f for all x G [a, 6] if 
and only if F is ACG^: on [a, b], F{a) = 0, and F' = f almost everywhere on 
(a, b). If f exists and f is continuous at x G (a, b) then ^ f = f{x)- 

II Let F : [a, b] M. Then F is ACG^ if and only if F' exists almost 
everywhere on {a,b), F' is Henstock integrable on [a,b], and P F' = F{x) — 
F{a) for all x G [a, b] . 

Here is a useful sufficient condition for integrability of the derivative: 

Corollary 3 Let F : [a^b] — M be continuous on [a, b] and differentiable 
nearly everywhere on {a,b). Then F' is Henstock integrable on [a, 6] and 
p F' = F{x) - F{a) for all x G [a, b] . 

The improvement over the Riemann and Lebesgue cases is that we need 
not assume the integrability of F'. Integration and differentiation are now 
inverse operations. To make this explicit, let A be the vector space of Hen- 
stock integrable functions on [a, b] C [—oo, oo], identified almost everywhere. 
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Let B be the vector space of ACG^ functions vanishing at a. Let j be the 
integral operator defined by j[f]{x) = f for f E A. Let D be the dif- 
ferential operator defined by D[f]{x) = f'{x) for f E B. The Fundamental 
Theorem then says that D o J = and J oD = Is- 

3. Differentiation under the integral sign. 

Theorem 4 Let f : [a,P] x [a,b] M. Suppose that f{-,y) is ACG^^ on 
[a,f3] for almost all y G {a,b). Then F := J^^ f{-,y)dy is ACG^, on [a,f3] 
and F'{x) = J^^ fi{x, y) dy for almost all x G (a, (3) if and only if 

t b b t 

J fi{x,y)dydx = J j fi{x,y)dxdy for all [s,t] C [a, p]. (1) 

x=s y=a y=o, x=s 



Proof: Suppose F is ACG^ and ^ f{x^y) dy = fi{x^y) dy. Let 
[s, t] C [a, 13]. By the second part of the Fundamental Theorem, applied first 
to F and then to f{-,y), 



t b 



j j fi{x,y)dydx = F{t)-F{s) 



x=s y=a 

b 



I [f{t,y)-f{s,y)]dy (2) 



y=a 
b t 

fi{x,y)dx dy. 

y=a x=s 

Now assume (0). Let x G (a, P) and let /i G M be such that x + h G {a, P). 
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Then, applying the second part of the Fundamental Theorem to f{-,y) gives 

x+h b b x+h 

fi{x',y)dydx' = fi{x',y)dx'dy 



x'=xy=a y=ax'=x 

b 



[f{x + h,y)- f{x,y)] dy 

y=a 

b b 

f{x + h,y)dy- j f{x,y)dy. (3) 

y=a y=a 



And, 



F'{x) = lim i [F{x + h)- F{x)] 

x+h b 



limi y j fi{x',y)dydx' 



x'=x y=a 



rb 

I fi{x,y) dy for almost all x G 

J a 



The last line comes from the first part of the Fundamental Theorem. Repeat- 
ing the argument in (||) shows that f^F' = F{x) — F{a) for all x G 
Hence, F is ACG^ on [a,P]. ■ 

The theorem holds for — oo<a</3<oo and — oo<a<6<oo. Partial 
versions of the theorem are given in 0, p. 357] for the Lebesgue integral and in 
p|, p. 63] for the wide Denjoy integral, which includes the Henstock integral. 

From the proof of the theorem it is clear that only the linearity of the 
integral over y G [a, b] ((H) and (||)) comes into play with this variable. Hence, 
we have the following generalisation. 

Corollary 5 Let S be some set and suppose f :[a, (3] x S ^ M.. Let f{-,y) 
be ACG^ on [a,/?] for all y E S. Let T be the real-valued functions on S and 
let C be a linear functional defined on a subspace ofT. Define F:[a,P] — M 
by F{x) = C[f{x, ■)]. Then F is ACG, on [a,p] and F'{x) = C[fi{x, •)] for 
almost all x G {a, f3) if and only if 
t pt 
C[fi{x,-)\dx = C I fi{x,-)dx for all [s,t] C [a, (3]. 
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If /(x, y) = g{x', y) dx' then /(-, y) is automatically ACG^. This gives 
necessary and sufficient conditions for interchanging iterated integrals. 

Corollary 6 Let g : [a, (3] x [a, b] M. Suppose that g{-, y) is integrahle over 
[a,/3] for almost ally G {a,b). Define G{x) = J^^ g{x',y) dx' dy. Then G 

is AGG^, on [a, (3] and G'{x) = g{x,y) dy for almost all x G {a, (3) if and 
only if 

t b b t 

g{x,y)dydx= J J g{x,y)dxdy for all [s,t] C [a, P]. (4) 

x=s y=a y=o, x=s 

Combining Corollaries ^ and ^ gives necessary and sufficient conditions 
for interchanging summation and integration. 

Corollary 7 Let : [a, /5] x N ^ R and write gn{x) = g{x,n) for x G 
[a, (3] and n E N. Suppose that gn is integrahle over [a, [3] for each n G N. 
Define G{x) = J2'^=i la 9^^^'^ ^^^'^ ^ ^■^ AGG^ on [a,P] and G'{x) = 
gn{x) for almost all x G (a, /3) if and only if 

t t 

/oo oo « 

^5(„(x) = ^ / gn{x) dx for all [s,t] C [a,f3]. (5) 
n=l n=l 
x=s x=s 

The Fundamental Theorem and its corollary yield conditions sufficient to 
allow differentiation under the integral. 

Corollary 8 Let f -.[a, (3] x [a, 6] M. 

i) Suppose that f{-,y) is continuous on [a, (3] for almost all y G (a, 6) and 
is differentiable nearly everywhere in {a,P) for almost all y G (a, 6). // (|I]) 
holds then F'{x) = J^^ fi{x, y) dy for almost all x G (a, j3). 

ii) Suppose that f{-,y) is AGG^ on [a,P] for almost all y G (a, 6) and that 
j'a fii'iV) dy is continuous on [a,j3]. If (|l]) holds then F'{x) = fi{x,y) dy 
for all X G (a, /?). 

Here is an example of what can go wrong when one differentiates under the 
integral sign without justification. In 1815 Cauchy obtained the convergent 
integrals 



sinfx^l 



cos(x^) I — 2 V 2 



cosfsx) dx = -\ — 



s^\ . fs" 



cost - 1 Tsmi - 



x=0 
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He then differentiated under the integral sign with respect to s and obtained 
the two divergent integrals 



smi^x 
cos(x^ 



sm(sx) dx ' 



S 71 

4V2 



sm 



± cos 



.2\-\ 



x=0 



These divergent integrals have been reproduced ever since and still appear 
in standard tables today, listed as converging. This story was told in [0. 
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